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Method for efficient retransmission timeout estimation in NACK-based protocols 



CROSS REFERENCE TO RELATED APPLICATION 

This application claims the benefit of U.S. Provisional Application Serial No. 
60/262,591 filed January 18, 2001, the teachings of which are incorporated herein by 
reference. 

BACKGROUND OF THE INVENTION 

Field of invention 

The present invention relates to retransmission timeout (RTO) estimators, and 
particularly, to a system and method for estimating RTO in the NACK-based real-time 
streaming applications that support multiple re-transmission of the same packet. 

Description of the Invention 

In general, there are two types of Internet transport protocols that support lost 
packet recovery in a data communication network. The first approach is ACK-based as set 
forth under the transmission control protocol (TCP), which involves the receiver sending a 
positive acknowledgment (ACK) in response to each received packet. The second approach 
is NACK-based under a user datagram protocol(UDP), which involves the receiver sending a 
negative acknowledgment (NACK) in response to each lost packet. 

Referring to FIG. 1(a), TCP utilizes a system of positive acknowledgments 
(ACK) for data arriving to the receiving endpoint as the mechanism for error recovery. This 
system operates vmder the principle that only unacknowledged frames should be 
retransmitted. To ensure that the packet is safely received by the sending source, TCP uses a 
retransmission timeout (RTO) mechanism by managing a retransmission timer for each 
connection. Hiat is, TCP sets the retransmission timer and tacks an RTO value and a round 
trip time (RTT) for the connection. The RTT is the time elapsed between the start of 
transmission of a TCP-type data segment and the receipt of an acknowledgment of that 
segment. If an acknowledgment is not received by the time the RTOi expires, TCP 
retransmits the data again within next the RTO2. 
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In contrast, UDP utilizes a system of negative acknowledgments (NACK) by 



forwarding a NACK packet to the sending source in response to the lost j&ame for 
retransmission, as shown in FIG. 1(b). In addition, the NACK packet can be lost along the 
path from the receiver to tiie sender. To this end, UDP utilizes a retransmission timeout 
5 mechanism that is similar to the TCP for retransmission connection. 



Normally, the RTO estimation is performed by predicting the next value of the RTT based on 
the previous samples of the RTTs. If the RTO is overestimated, it leads to lower throughput 
performance in TCP and may caxise an increased nimiber of under-flow events in real time 
10 application. Yet, if the RTO is xmderestimated, the protocol generates a large number of 
duplicate packets that cause serious network congestion as more of imnecessary packets are 
retransmitted. 

A background of current standards, which is based on TCP's retransmission timeout 
estimator, is described hereinafter. The standard consists of two algorithms described below. 
1 5 The first algorithm, smoothed RTT estimator (SRTT), is based on an exponential- weighed 
moving average (EWMA) of the past RTT samples: 



20 where RTTi represents the z-th sample of the round-trip delay produced at time ti and a (set by 
default to 1/8) represents a smoothing factor that can be varied to give more or less weight to 
the history of RTT samples. 



It is important that the estimation of an RTO value is performed accurately. 




(1) 



25 



The second algorithm, smoothed RTT variance estimator (SVAR), computes an 
approximation to the RTT variance using similar EWMA formulas to the ones described 
above: 




(2) 



30 



where fi (set by default to %) represents an EWMA smoothing factor and 
VARi represents the absolute deviation of the /-th RTT sample ftom the smoothed average: 
VARi=\SRTTi.i-RTT,\. 
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Finally, the RTO is determined by multiplying the smoothed variance by four 
and adding it to the smoothed round-trip delay: 

RTO(t) = SRTTi + 4 • SVARt , (3) 

5 

where / represents the time at which the RTO is computed, and / = max: < L 
In real-time streaming applications, e.g., multimedia applications, NACK- 
based operation is preferred due to a lower overhead along the path from the receiver to the 
sender and potentially faster recovery of lost packets. However, the RTO estimator, as 

1 0 described in the preceding paragraphs, is typically suitable only for the ACK-based 
applications and is not applicable to NACK-based protocols by design. It produces an 
extended number of duplicate packets and causes imnecessary delays in the generation of the 
subsequent NACK requests in real-time streaming applications due to poor prediction of the 
next RTT value. In addition, NACK-based protocols do not have a common RTO estimation 

1 5 scheme that works well in heterogeneous Internet conditions. Despite these drawbacks, many 
NACK-based protocols are still utilizing the existing RTO estimating protocol, which is 
borrowed from TCP. 

As described above, an RTO estimator is described by two parameters - the 
number of duplicate packets and the amount of uimecessary time out waiting. However, 

20 these two parameters cannot be minimized at the same time as they represent a basic trade- 
off of the estimator (i.e., decreasing one parameter will increase the other). Smce TCP*s 
RTO estimator proves to be inapplicable in NACK-based protocol, there is a need for such 
protocols to employ the class of optimal RTO estimators, which are described in this patent 
disclosure. 

25 

SUMMARY OF THE INVENTION 

In the preferred embodiment, the present invention is directed to a method and 
system for estimating retransmission timeout (RTO) in a real-time streaming applications 
over the Internet between a server and a client . 
30 According to the preferred embodiment, the present invention provides a 

method of estimating retransmission timeout {RTO J) used in a communication system to 
support multiple retransmission and the method includes the steps of: transmitting a plurality 
of data packets from a server to a client; transmitting a negative acknowledgment (NACK) 
packet for retransmission by the client if one of the data packets is missing; computing a 
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round-trip delay (RTTi) corresponding to a latency between sending the NACK packet to the 
server and receiving the corresponding retransmission of the missing packet from the server; 
calculating a plurality samples of delay (Aj) between fhe reception adjacent packets of the 
plurality of data packets by the client; determining a smoothed inter-packet delay variance 
5 (SVARAj) based on the calculated delay samples; and, computing the RTOj based on the 
determined RTTt and the determined smoothed inter-packet delay variance. 

According to preferred embodiment, the present invention provides a system 
of managing transmission of a plurality of data packets over a communications linlc between 
a server system and a client system and includes: a means for receiving the data packets in 

1 0 the form of frame comprised of packets; a means for determining whether any frame packets 
were lost during transmission; a means for requesting that any lost frame packets be 
retransmitted; a means for determining a round-trip delay {RTTi) corresponding to a latency 
between requesting retransmission of the lost frame to the server and receiving the 
corresponding retransmission of the lost frame from the server; a means for determining 

1 5 inter-burst packet delay variations; and, a means for determining a retransmission timeout 
(RTOJ) based on the determined RTT and the determined inter-burst delay variations. 

These and other advantages will become apparent to those skilled in this art 
upon reading the following detailed description in conjunction v^th the accompanying 
drawings. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 (a) illustrates representative data flows in the TCP communication 

environment; 

FIG. 1 (b) illustrates representative data flows in the UDP communication 

25 environment; 

FIG. 2 illustrates a block diagram of a system according to the present 

invention; 

FIG. 3 illustrates the various layers that make up the Transmission Control 
Protocol/Internet Protocol (TCP/IP); 
30 FIG. 4(a) illustrates the format of a user datagram protocol (UDP) packet at 

the server end in accordance with the present invention; 

FIG. 4(b) illustrates the format of a user datagram protocol (UDP) packet at 
the client end in accordance with the present invention; 
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FIG. 5 illustrates a time chart depicting the jitter-based retransmission timeout 
(RTO) estimation according to the present invention; and, 

FIG. 6 is a flow chart illustrating the operation of the retransmission timeout 
(RTO) estimator according to the present invention. 

5 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

In the following description, for purposes of explanation rather than limitation, 
specific details are set forth such as the particular architecture, interfaces, techniques, etc., in 
order to provide a thorough understanding of the present invention. However, it will be 

1 0 apparent to those skilled in the art that the present invention may be practiced in other 

embodiments which depart from these specific details. Moreover, for the purpose of clarity, 
detailed descriptions of well-known devices, circuits, and methods are omitted so as not to 
obscure the description of the present invention wilh unnecessary detail. 

According to an embodiment of the present invention, a mechanism for 

1 5 controlling the retransmission of data packets in a digital communication enviroimient is 

provided. Referring to FIG. 2, a system 10 which uses the invention comprises a first system 
12, such as a server device, a second system 14, such as a client device, which is in 
communication with each other via access link of the network 16, Preferably, the inventive 
retransmission mechanism is placed at the client system. As shown in FIG. 2, the present 

20 invention can be practiced in a client-server environment, but the client-server environment is 
not essential. 

In this invention, the server system 12 sends at least one source packet or 
sends packets in bursts to the client system 14 over the network. However, in the event that 
the source packet or burst packets from the server system 12 to the client system 14 is 

25 transmitted in error or lost, the client system 14 transmits a negative acknowledgment 
(NACK) packet to the server system 12 for retransmission. Then, the client system 14 
establishes a limit on the timer period and retransmits the NACK packet to the server system 
12 if the requested packet or burst packets are not received within a specified time period. 

It should be noted that many real-time streaming servers are implemented to 

30 transmit their data in burst packets instead of sending one packet every specified period. This 
type of burst transmission typically reduces the overhead associated with frequent switching 
between processors. In addition, the bursty packet transmission is more adapted to handle 
varying packet sizes and allows more simultaneous streams per server. However, it is not 
required. 
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According to an embodiment of the present invention, packets that are 
received in error or lost are notified back to the server system 12 by the client system 14 via a 
NACK packet. Here, a user datagram protocol (UDP) is utilized. FIG. 3 depicts the various 
layers that make up the Transmission Control Protocol/Internet Protocol CTCP/IP) suite. 
5 Basically, TCP provides end-to-end transport services across multiple heterogeneous 

networks and the delivery of sequenced packets of information across the Internet. UDP is a 
connection-less transport protocol designed to operate using the service of IP and provides 
minimal error detection for streams of information. At the network level, IP provides a 
"datagram" delivery service. 

1 0 The format of a UDP packet according to the present invention is shown in 

FIG. 4(a) and FIG. 4(b). Each packet in a real-time application carries a burst identifier, 
which allows the receiver to distinguish packets from different bursts. Referring to FIG. 1(b), 
a NACK packet is send to the server system if the source packet therefi-om is lost along the 
transmission path. The loss of packets is detected by system 14 through gaps in sequence 

1 5 numbers. For each NACK-packet transmitted, the inventive protocol maintains a tuner. If 
the timer expires, the NACK-packet is retransmitted. To avoid the confiision of which 
retransmission of the same packet actually returned to the client system, the header of each 
NACK packet contains an extra field specifying the retransmission sequence coxmt in 
addition to the lost packet sequence number, as shown in FIG. 4(b). Thus, the client system 

20 can pair each retransmitted packet with the exact time when the corresponding NACK packet 
was sent out and properly measure the RTT. 

As the source packets are being transmitted over a path with unpredictable 
delay, the present invention continuously adjusts the threshold at which the retransmit timer 
expires. That is, the transmission path changes during the lifetime of the connection, and the 

25 state of the routers (or switches) also changes as more or less traffic is being carried by the 
network. Accordingly, the present invention incorporates a new round-trip estimation 
mechanism that can be used to determine more accurate timing in retransmitting the NACK- 
packet. Unlike the prior art, estimate of the delay jitters between arriving packets is used in 
the present invention as the basis to set the retransmit timer threshold. 

3 0 The following description is a detailed description of specific algorithms of a 

retransmission mechanism according to the present invention. In real time multimedia 
applications, the server system 12 typically sends packets in bvirsts for the duration of time, 
Db* Here, Dt is based on the streaming rate and the average packet size. Referring to FIG. 
5, for each bursty, the last packet of the burst arrives to the client at time tj and the first 
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packet of the bxirst arrived at time tj Thus, the inter-burst delay for burst j can be defined 
as below equation 4: 

where burst k represents the last burst received before burst j (unless there is 
packet loss, fc=j-l). For each burst j\ using EWMA formulas similar to those in TCP, the 
smoothed inter-burst delay SAj and smoothed inter-burst delay variance SVARAj are 
computed as defined in the following equations (5) and (6): 



(5) 

(l-.a)*5A^.^j+ai*A^.,7>l ^ ^ 



and 



where ai and Pi represent exponential weights and VARAj represents the 
absolute deviation of Aj from its smoothed version SAj^j . Here, SAj is typically proportional 
to the burst duration Z)^, and thus it caimot be used the same way in real-time applications 

20 with a different burst duration. However, the smoothed variance SVARAj is fairly 

independent of the burst duration and reflects the variation in the amount of cross traffic in 
the router queues along the path from the server to the client. 

With the transmission delay and its delay variation from equation (6), if 2} is 
the time when the client produced the j-th sample of the inter-burst delay Ay (ideally, 3} equals 

25 f/"') and t[ is the time when the client computed the /-th RTT sample RTTi (explained later), 
then the effective Jitter-based RTO according to the present invention at time / is: 

RTOj (0 = n * RTTi+ m * SVARAj, (7) 



30 



where / = max \ti<t and j = max :Tj < t. 



wo 02/058309 PCT/IBO 1/02649 

8 

Furthermore, in the event that there is a longer delay between the 
measurements of the RTT, a slight modification to equation (7) can be provided to better 
approximate the RTO. This better estimator, called RTOjOy can be created by incorporating 
the duration between the time of the last RTT sample (i.e., U ) and the time where the RTO is 
5 being estimated (i.e., t) into the RTOj estimator: 

RTOjD(f) = (n-^k(t-ti)) * RTTi-^m*SVARAj, (8) 
where / = max : ti <t, y = max :Tj <t, and time units for t and // are seconds. 

10 It should be noted that both jitter-based RTO estimators, as described in the 

preceding paragraphs, achieve optimality when ai = 0.5, Pi = 0.25, k= 0.5, and m = 4.2792 * 
ft - 2.6646. The remaining free parameter n can be used to vary the desired nimiber of 
duplicate packets on a per-application basis: higher values of n correspond to fewer duplicate 
packets. The recommended values of n are between 1 and 4. It should be noted that frequent 

15 delay jitter samples prove to be very helpfiil in fine tuning NACK-based RTO estimation and 
can be used as a good predictor of the changes in the future RTTs. 

It should be noted that the estimator of the present invention for determining 
the retransmission timeout (RTO) can be realized using a processor, microcomputer, an 
application-specific integrated circuit (ASIC), a programmable device, or any other device 

20 designed and operated to provide the functionality described herein. A flow chart of a key 
operation of the estimator is shown in FIG. 6, as hereinafter explained. 

Referring to FIG. 6, each packet is plugged into an estimator algorithm that 
tracks two quantities: the round trip delay estimate (RTT) and the variance in inter-burst 
delay jitter (SVARA). In step 600, each packet is received at the client system. If there were 

25 missing packets, a NACK packet for each packet is sent to the service system in step 610. In 
such a case, the transmission time of each NACK packet requesting a retransmission of 
packet (i), nackj, is recorded, then the timer to transmit the subsequent NACK packet is set in 
step 610. Meanwhile, if retransmission of the data packet is reliably completed from the 
server to the client system, the round trip delay (RTT) is computed in step 620. 

30 According to the embodiment of the present invention, the receiver in a real- 

time session must periodically measure the round-trip delay. The client system obtains the 
RTT measurements by utilizing packet loss to measure the roimd-trip delay - each 
successfully recovered packet provided a sample of the RTT. That is, the RTT is the duration 
between sending a NACK and receiving the corresponding retransmission. Alternatively, the 
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RTT is measured by the client by obtaining additional samples of the round-trip delay in 
cases when network packet loss was too low. To this end, the client periodically transmits 
simidated retransmission requests to the server if packet loss falls below a certain threshold. 
In response to these simulated NACKs, the server sends the needed packets to the client. 

5 In step 630, it is determined whether the received packet belongs to the same 

burst as the previously received packet. If it is different, in step 640, the inter-burst delay is 
computed, as described in equation 4. The inter-burst delay is measured between the receipt 
of the first packet of the burst and the last packet of the previous burst at the client side. To 
distinguish between different bursts and utilize equation (4), the system records the 

1 0 parameters of the last received packet in step 650. 

Next, the inter-burst delay samples are averaged into a smoothed inter-burst 
delay (S A) estimate, which is then used to control the retransmissions time-out parameter 
(RTO). Using step 660, for each burst, smoothed inter-burst delay and smoothed inter-burst 
delay variance are calculated in step 670 and 680, respectively. Step 670 is perfomied to 

1 5 update the smoothed inter-burst delay value, which is used for determining the variance in 
the subsequent calculation process. These steps are executed according to equations 5 and 6. 
Hence, as each new packets are added, the mean and variance change. 

Finally, the retransmit timeout mechanism (RTO), which is a timeout to 
prompt retransmission of unrecovered data, is calculated in step 690. The latest RTT sample 

20 has the most relevance to the value of the future round-trip delay due to the large spacing 

between RTT samples in NACK-based applications. Upon expiration of the timer for packet 
(i), the client system 14 retransmits the NACK packet, nackj, and sets the timer for another 
RTO time unit for packet (i). The recommended values of n are between 0 and 4, and the 
value of w is set to: m = 4.2792 * « - 2.6646. 

25 In summary, the present invention provides a new RTO estimation 

mechanism, which achieves significant performance improvements (i.e., fewer duplicate 
packets and less unnecessary waiting time) over the existing RTO estimation algorithms 
when employed in NACK-based protocols. Having thus described a preferred embodiment 
for managing retransmission over a digital communications link, it should be apparent to 

30 those skilled in the art that certain advantages of the system have been achieved. The 
foregoing is to be constructed as only being an illustrative embodiment of this invention. 
Thus, persons skilled in the art can easily conceive of alternative arrangements providing a 
functionality similar to this embodiment without any deviation from the fimdamental 
principles or the scope of this invention. 
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1 . A method for estimating retransmission timeout (RTOj) used in a 
communication system to support multiple retransmission of the same packet between a 
server (12) and a client (14), the method comprising the steps of: 

(a) transmitting a plurality of data packets from said server (12) to said client 

5 (14); 

(b) transmitting a negative acknowledgment (NACK) packet for 
retransmission by said client (12) if one of said data packets is missing; 

(c) computing a round-trip delay (RTTi) corresponding to a latency between 
sending said NACK packet to said server and receiving the corresponding retransmission of 

10 said missing packet from said server (12); 

(d) calculating a plurality samples of delay (Aj) between the reception of 
adjacent packets of said plurality of data packets by said client (14); 

(e) determining a smoothed inter-packet delay variance (SVARAJ) based on 
said calculated delay samples; and, 

1 5 (f) computing said RTOj based on said determined RTTi and said determined 

smoothed inter-packet delay variance. 

2. The method of claim 1, further comprising the step of controlling 
retransmission of said NACK based on said computed RTOj, said computed RTOj being a 

20 delay between subsequent transmissions of said NACK packet from said client (14) to said 
server (12). 

3. The method of claim 1, wherein said SVARAj is determined according to 
SVARAj == (1 -^i) * SVARAj.! +^ i * A 

25 wherein fi \ being set to 0.25 and D being the absolute difference of Aj - SVARAj.j, 

4. The method of claim 1, wherein said RTOj is determined according to 
RTOj =n* RTTi-\- m * SVARAj, 

wherein n being set between 0 and 4 and m being set to m = 4.2792 * w - 2.6646. 
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5. The method of claim 1, wherein the data packets are burst packets and the 

delay is inter-burst delay. 

5 6. A system for estimating retransmission timeout (RTO) used in a 

communication system to support multiple retransmission of the same packet between a 
server system (12) and a client system (14), comprising: 

means for controlling said multiple retransmissions of a data packet between 
said server (12) system and said client system (14) over said communication link based on an 

10 actual around-trip delay (RTT) and a smoothed inter-packet delay variance (SVARAj) 

associated with said client (14) system, said RTT being a latency between sending a negative 
acknowledgment (NACK) packet to said server system (12) responsive to a lost packet and 
receiving the corresponding retransmission of said lost packet from said server (12), said 
smoothed inter-packet delay variance (SVARAj) being variation of delays before and after 

1 5 each received packet or burst of packets, whereby the over-estimation and imder-estimation 
of said RTO is relatively minimized. 

7. A system for mans^ing transmission of a plurality of data packets over a 
commxmications link between a server system (12) and a client system (14), comprising: 

20 means for receiving said data packets in the form of frame comprised of 

packets; 

means for determining whether any frame packets were lost during 

transmission; 

means for requesting that any lost frame packets be retransmitted; 
25 means for determining a roimd-trip delay (RTTi) corresponding to a latency 

between requesting retransmission of said lost frame to said server (12) and receiving the 
corresponding retransmission of said lost frame from said server (12); 

means for determining inter-burst packet delay variations; and, 
means for determining a retransmission timeout {RTO J) based on said 
30 determined RTT and said determined inter-burst delay variations. 

8. The system of claim 7, wherein said means for determining said RTOj fiirther 
comprises a means for determining an inter-burst delay (Aj) between the reception of a first 
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packet of said lost burst packets and a last packet of a prior burst packets; and, a means for 
determining a smoothed inter-burst delay variance (SVARAj)^ 

9. The system of claim 7, further comprising a means for controlling multiple 
retransmission of said NACK based on said computed RTOj, said computed RTOj being a 
delay transmission of said NACK packet from said client (14) to said server (12). 

10. The system of claim 7, wherein said SVARAj is determined according to 
SVARAj = (1 -/?i) * SVARAj. J + ^ i * A 

wherein i being set to 0.25 and D being the absolute value of Ay - SVARAj, j. 



1 1 . The system of claim 7, wherein said RTOj is determined according to 

RTOj = n* RTTi+ m * SVARAj, 

wherein n being set between 1 and 4 and m being set to w = 4.2792 * « - 2.6646. 



wo 02/058309 



PCT/IBOl/02649 





wo 02/058309 



PCT/IBOl/02649 



2/4 



12 SERVER SYSTEM 



14 CLIENT SYSTEM 




CPU 



MEMORY 



OPERATING 
SYSTEM 



10 

/ 



16 



ACCESS 



LINK 



ACCESS 



r 

NETWORK 

) LINK 




FIG. 2 



APPLICATION LAYER 



TCP 



USER 
DATAGRAM (UDP) 



NETWORK LAYER (IP) 



DATALINK/ PHYSICAL LAYER 



FIG. 3 



wo 02/058309 



PCT/IBOl/02649 



3/4 



UDP HEADER 



PACKET 
SEQUENCE #(m) 



BURST #0) 



RETRANSMISSION COUNT 



DATA PAYLOAD 



FIG. 4(a) 



UDP HEADER 


PACKET SEQ.# 


RETX COUNT 



R6. 4(b) 



NACK 
BURST y-2 



RECEIVER 
SIDE 



TIMEWHEN THE CUENT GENERATED THE /-Ih 
SAMPLE OFTHERH 

H 



RTO ESTIMATION 
time/ 



BURST /-1 



/ 




BURST / 



t 1.-^14 t 



.first .last 
^ i-2 



t 



first . last 

i-1 



Jirst 



last 



curjime 

FIG. 5 



time 



wo 02/058309 



PCT/IBOl/02649 



4/4 



600 



610 



(start) 

RECEIVE PACKET m 

FROM THE SERVER 



IF THESE ARE MISSING PACKETS 

BEFORE PACKED K, SEND A 
NACK FOR EACH PACKET I.AND 
RECORD CURRNT TIME IN nack: 
SETTIMERTOEXPIREAT 
curJme+RTO 




COMPUTE DEVIATION 
D = Aj-SAj.^ 



670 



680 



SAj = SAj.-| + oc, D 



690 



SVARAj = 
(1-B^)SVARAj.i=B2lD1 



MEMORY 



nack 



lasl burst 



last 



RTT 



SA 



j-1 



SVARA 



i-1 



RTO 



<-- - 



RTO = n»Rn + m« SVARA 



( END ) 



-> 





f 


RECEIVE 
RETRANSMIHED 
PACKET! 




f 


COMPUTE 

RTT = curJme_nackj 


1 
1 





620 



FIG. 6 



